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Abstract 

We consider a class of well-known dynamic resource allocation models in loss network systems with 
advanced reservation. The most important performance measure in any loss network system is to compute 
its blocking probability, i.e., the probability of an arriving customer in equilibrium finds a fully utilized 
system (thereby getting rejected by the system). In this paper, we derive upper bounds on the asymptotic 
blocking probabilities for such systems in high-volume regimes. There have been relatively few results on 
loss network systems with advanced reservation due to its inherent complexity. The theoretical results 
find applications in a wide class of revenue management problems in systems with reusable resources 
and advanced reservation, e.g., hotel room, car rental and workforce management. We propose a simple 
control policy called the improved class selection policy (ICSP) based on solving a continuous knapsack 
problem, similar in spirit to the one proposed in Levi and Radovanovic (2010). Using our results derived 
for loss network systems with advanced reservation, we show the ICSP performs asymptotically near- 
optimal in high-volume regimes. 
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1 Introduction 


In this paper, we consider a class of well-known dynamic allocation problems in loss network systems with 
advanced reservation. The stochastic system consists of a homogeneous pool of resources with a known fixed 
capacity. Requests for using this pool of resources belong to a diverse set of customer classes, differing in 
the arrival rate, the advanced reservation duration (the time between a request and its start of service), 
the service duration, and the willingness to pay. In particular, each customer requests a service interval, 
specifying a start time (potentially in the future) and an end time. Customers cannot be delayed and their 
requests must be addressed instantaneously upon arrival. That is, each request must either be reserved 
into the system for service and assigned an appropriate resource unit for its requested service interval or 
rejected (lost) at the instant it arrives. An admitted request occupies the allocated resource unit for its 
service duration and releases the resource unit after the service is completed. The released resource unit 
can be used to serve other customers. The goal is to design an admission control policy that optimizes the 
expected long-run average revenue rate. 

Dynamic allocation problems in loss network systems with advanced reservation are motivated by both 
traditional and emerging application domains, such as hotel room , car rental and workforce management. For 
instance, in hotel industries, customers make requests to book a room in the future for a specified number 
of days, which is often referred to as advanced reservation. Rooms are allocated to customers based on their 
requests, and after one customer used a room it becomes available to serve other customers. One of the 
major issues in these systems is how to manage capacitated pool of reusable resources over time in a dynamic 
environment with many uncertainties, in order to maximize the long-run expected revenue. 
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1.1 Main results and contributions of this paper 

Firstly, we provide the first asymptotic analysis on the blocking probabilities in loss network systems with 
discrete advanced reservation and service distributions. The customers arrive to a service system (with 
capacity C ) according to M-class Poisson processes and are being served as long as there is available reser¬ 
vation capacity. Customers who find a fully utilized system are rejected and lost (see, e.g., Kelly (1991)). 
Let the traffic intensity p = YlkLi ^kPk where A k and pu are the Poisson arrival rate and the mean service 
time of class k, respectively. We derive explicit upper bounds on the steady-state blocking probability , i.e., 
the probability that a random customer at steady-state will find a fully utilized system (and is therefore 
rejected), and analyze them asymptotically in high-volume regimes. 

Theorem 1. Consider a loss network system with discrete advanced reservation and service distributions. 
Let C and p be the capacity and the traffic intensity of the system, respectively. 

(a) Under the high-volume regime where C = p —> oo, the blocking probabilities have an asymptotic upper 
bound of 1/2. 

(b) Under the high-volume regime where C = (1-1 -e)p —> oo for any small positive e, the blocking probabilities 
are asymptotically zero. 

To the best of our knowledge, there have been very few successful attempts to characterize the blocking 
probabilities for loss network models with advanced reservation (see, e.g., Coffman-Jr et al. (1999) and 
Lu and Radovanovic (2007) that studied several special cases). One of the major difficulties in models with 
advanced reservation is the fact that a randomly arriving customer effectively observes a nonhomogeneous 
Poisson process that is induced by the already reserved service intervals. Moreover, analyzing the blocking 
probability of an arriving customer requires considering the entire requested service interval instead of the 
instantaneous load of the system. Analyzing the load over an interval immediately introduces correlation 
that is challenging to analyze. The upper bound on the blocking probability is obtained by considering 
identical systems with infinite capacity, where all customers are admitted ( M/G/oo systems with advanced 
reservation). The probability of having more than C customers reserved in the infinite capacity system 
provides an upper bound on the blocking probability in the original system; we call this the virtual blocking 
probability. Through an innovative reduction to an asymmetric random walk, we obtain an exact analytical 
expression for this virtual blocking probability and then analyze it asymptotically. The analytical techniques 
used in developing our results are completely different from the ones used in Levi and Radovanovic (2010). 

Secondly, the theoretical results in loss network systems with advanced reservation find interesting appli¬ 
cations in revenue management of reusable resources with advanced reservation, e.g., hotel room, car rental 
and workforce management. A simple control policy called the improved class selection policy (ICSP) is 
proposed based on solving a continuous knapsack problem, similar in spirit to Levi and Radovanovic (2010). 
Using our results derived for loss network systems with advanced reservation, we show that the ICSP performs 
asymptotically near-optimal in high-volume regimes. 

Theorem 2. Consider the revenue management model with a single pool of capacitated reusable resources 
and advanced reservation under the ICSP. Under the high-volume regime where C = (1 + e)p oo for any 
small positive e, the ICSP is guaranteed to obtain at least (1 — e) of the optimal long-run expected revenue. 

We also carried out an extensive numerical study on the ICSP in comparison with the optimal stochastic 
dynamic programming solutions. Our results show that our policy performs within a few percentages of the 
optimal for a large set of parameters (even in light-traffic). There have been relatively few results on loss 
network systems with advanced reservation, and we believe that the approaches developed in this paper will 
be applicable in other applications domains in operations management. 
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1.2 Relevant Literature 


Loss network systems without advanced reservation are well-known; they were introduced over four decades 
ago and have been studied extensively, primarily in the context of communication networks (e.g., the survey 
paper by Kelly (1991)) and recently other application domains. Two of the major issues in the literature 
on loss networks have been the study and design of heuristics for admission control (e.g., Miller (1969), 
Ross and Tsang (1989), Key (1990), Kelly (1991), Hunt and Laws (1997), Puhalskii and Reiman (1998), 
Fan-Orzechowski and Feinberg (2006)), and the development of approximations and bounds as well as sen¬ 
sitivity analysis of blocking probabilities with respect to input parameters and resource capacities (e.g., 
Erlang (1917), Sevastyanov (1957), Kaufman (1981), Burrnan et al. (1984), Whitt (1985), Kelly (1991), 
Ross and Yao (1990), Zachary (1991), Louth et al. (1994), Kumar et al. (1998) and Adelman (2006)). How¬ 
ever, there have been relatively few successful attempts to characterize the blocking probabilities for the 
loss network systems with advanced reservation. In particular, all the results mentioned above do not carry 
through. Coffman-Jr et al. (1999) derived explicit formulas for the limiting blocking probabilities in several 
special cases, for instance, in a setting where the reservation distribution is uniform and all requested in¬ 
tervals have unit length. They extended the result to more general reservation distributions by relating the 
problem to an on-line interval packing problem. Lu and Radovanovic (2007) studied the asymptotic blocking 
probabilities when the capacity of the system approaches infinity with sub-exponential resource requirements. 
Some papers are devoted to study the transient behavior or approximations of blocking probabilities for the 
Mt/G/oo queue as well as M t /G/C/C loss systems (without advanced reservation) where the arrival process 
is nonhomogeneous Poisson (e.g., Eick et al. (1993b, a)), Massey (1985) for the details on some of the results 
along these lines). The deterministic counterpart systems with advanced reservation have been considered 
in the scheduling and parallel computing literature, which is not the main focus of this paper. 

The theoretical results in the loss network systems with advanced reservation find interesting applica¬ 
tions in a class of revenue management problems. The most relevant prior work in these applications is 
Levi and Radovanovic (2010) which used a simple knapsack-type linear program (LP) to devise a concep¬ 
tually simple admission control policy called class selection policy (CSP) for the models without advanced 
reservation (i.e., all customers wish to start service upon arrival). The optimal solution obtained by solving 
the LP guides the policy to select the more profitable classes of customers. The LP provides an upper bound 
on the optimal expected long-run average revenue and can be used to analyze the performance of CSP. The 
analysis is based on the fact that the CSP induces a stochastic process that can be reduced to a classical loss 
network model without advanced reservation. They developed explicit expressions for the resulting blocking 
probabilities induced by the CSP, and then showed that the CSP is guaranteed to achieve at least half of the 
optimal long-run revenue. Also, the CSP was shown to be asymptotically optimal when the capacity goes to 
infinity. The knapsack-type LP considered by Levi and Radovanovic (2010) has been previously discussed 
by several other researchers (see, e.g., Key (1990), Hunt and Laws (1997)). In fact, a variant of the CSP has 
been discussed by Key (1990) and Kelly (1991), who analyzed the randomized thinning policy. Moreover, 
Key (1990) has shown that the variant of the CSP for the single resource case without advanced reserva¬ 
tion is asymptotically optimal in the critically loaded regime. Iyengar and Sigman (2004) have also used an 
identical LP to devise exponential penalty function control policies to approximately maximize the expected 
reward rate in a loss network. All of these works have considered models without advanced reservation. 


1.3 Structure of this paper 

The remainder of the paper is organized as follows. In Section 2, we describe the mathematical model. 
In Section 3, we present an asymptotic analysis on the blocking probabilities in loss network systems with 
advanced reservation. In Section 4, we focus on applications in revenue management of reusable resources 
with advanced reservation and draw connections between these applications and our theoretical findings in 
loss network systems. We propose an improved class selection policy and show that it performs asymptotically 
near-optimal. We extend our model to a pricing model in Section 5. In Section 6, we present the dynamic 
programming formulation and then demonstrate the empirical effectiveness of our policy. Finally we conclude 
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the paper with some future research directions in Section 7. The proofs of technical lemmas and propositions 
are provided in the Appendix. 


2 Loss Network Systems with Advanced Reservation 

We first describe a well-structured stochastic process called loss network systems with advanced reservation, 
i.e., M/G/C/C loss systems with advanced reservation. We consider a homogeneous pool of resources of 
integer capacity C < oo being used to satisfy the demands of M different classes of customers. The customers 
of each class k = 1,..., M, arrive according to an independent Poisson process with a class-dependent rate 
Afc. Each class-fc customer requests to reserve one unit of the capacity for a specified service time interval 
in the future. 

Let Dk be the reservation distribution of a class-fc customer, and Sk be the respective service distribution 
with mean (see Figure 1). In particular, upon an arrival of a class-fc customer at some random time 
t, the customer requests to reserve the service time interval [t + d, t + d + s], where d and s are drawn 
according to Dk and Sk , respectively. Thus, t + d is called the starting service time. Note that Dk and Sk 
are independent of the arrival process and between customers; however, per customer, Dk and Sk can be 
correlated. We assume that Dk is discrete with finite support [0 ,Uk] and Sk is discrete with finite support 

[Mk]- 


Poisson rate Ai 


reward rate r k 


time 


arrival 


requested service 


Dk S k 

Figure 1: Reservation distributions and service distributions 


The resource unit can be reserved for an arriving customer only if upon arrival there is at least one 
unit of capacity that is available (i.e., not reserved before time t ) throughout the entire requested interval 
[t + d,t + d + s], i.e., this request can only be satisfied if the maximum number of already reserved resource 
units over [t + d,t + d + s] is strictly smaller than the capacity C. Customers whose requests are not reserved 
upon arrival due to insufficient capacity are lost and leave the system. 

Upon reservation, the requested unit will then be fully committed and cannot be canceled for the reserved 
service interval. In addition, there is a class-specific reward rate of r*, collected per unit of service time. The 
key research question in loss network systems with advanced reservation is to characterize or upper bound 
the blocking probabilities , i.e., the long-run probabilities that a random customer sees a fully utilized system 
and is therefore blocked for service. 


3 An Asymptotic Analysis of Blocking Probabilities 

Before delving into details, we first give an overview of our analysis. Analyzing the original capacitated system 
seems rather difficult. Instead, we consider the counterpart system with infinite capacity (i.e., a M/G/oo 
system with advanced reservation) while keeping all other problem parameters fixed. In this counterpart 
system, all customers are admitted since there is an infinite number of resources. It is not hard to see 
that, for each sample path and each time i, the admitted customers reserved to get service in the original 
capacitated system are a subset of those reserved in the infinite capacity counterpart system. Consider now a 
customer arriving at some random time t. in the counterpart system with infinite capacity requesting service 
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interval [t + d,t + d + s\. Define the virtual blocking probability to be the probability that the maximum 
reserved capacity over the requested service interval [t + d, t + d + s] just prior to time t is larger than C. 
Since the set of served customers in the infinite capacity system is always a superset of that served in the 
original capacitated system, it follows that the virtual blocking probability is in fact an upper bound on the 
blocking probability in the original capacitated system. It makes sense to analyze the asymptotic behavior 
of the virtual blocking probabilities, which, in turn, provides us asymptotic upper bounds on the blocking 
probabilities in the original capacitated system. Let us start with the simplest non-trivial case (which gives 
us some insights into how to analyze such complex models), and gradually develop our main result for the 
general case. 


3.1 The Simplest Non-Trivial Case: Two-Point Distribution 


We will start the asymptotic analysis with the simplest non-trivial case, and then extend it gradually to the 
more general case. Suppose that S takes only one value s = 1 deterministically. Then the traffic intensity 
p = \p = A. In addition, assume that D follows a two-point distribution, 


D = 


w.p. 7 , 
w.p. I- 7 , 


i.e., fn{ 0) = 7 and /d(1) = 1 — 7 . That is, an arriving customer either wants to start the service immediately 
or in 1 unit of time. Consider the counterpart system with an infinite number of servers in steady-state (note 
that the steady-state exists due to the induced semi-Markov process). Upon a customer arrival to the system 
at some time t , all the starting service times of the customers who had arrived prior to t are already known. 
For ease of exposition, we call these starting service times pre-arrivals. Similarly, we call all the starting 
service times of the customers, who will arrive after t post-arrivals. Note that the pre-arrivals and post¬ 
arrivals are always defined with respect to the current time t. It is important to observe that the virtual 
blocking probability at time t (as well as the blocking probability in the original capacitated system) is 
independent of post-arrivals. Without loss of generality, we assume that t = 0 and the system reaches 
equilibrium. 

Lemma 1 below characterizes the pre-arrival processes (i.e., the booking profile) observed by a customer 
arriving at time 0 in steady-state. Let |Y] is the smallest integer not less than r. 

Lemma 1. Consider the counterpart system with an infinite number of servers, then a customer arriving at 
the system at time 0 in steady-state, observes that the pre-arrivals follow a non-homogeneous Poisson process 
with piecewise rate rj(r) at time r 


f A, if r < 0, 

V(r) = < (i - 7 )A, if 0 < r < 1, 

[ 0 , if r > 1. 

The proof of Lemma 1 is simple by using Poisson splitting arguments. In order to figure out how likely 
this customer (arriving in equilibrium) gets blocked, it is important to know the entire booking profile 
(consisting of committed services not yet started) at the moment of his or her arrival. Lemma 1 gives a 
compact description of this pre-arrival process as seen from t = 0. 

Let Nd{r) where r £ [0,1] be the Poisson counting process of the number of pre-arrivals over the interval 
[d — 1, d] as seen from time 0. The corresponding rates of this Poisson counting process are given by Lemma 
1. Next, we introduce the notion of mirror image of a Poisson counting process. The mirror image of a 
Poisson counting process Nd(r ), denoted by Nd(r ), is a backward counting process of Nd{r). More formally, 
Nd{r) = Nd( 1) — Nd( 1 — r) for each r £ [0,1]. It is evident that Nd is also a Poisson process with the same 
rate as Nd- We will use Nd(r) to model the departure process over the interval [d, d + 1] in reverse time. 
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Now let B be the event that a customer arriving at time 0 in steady-state is virtually blocked. The 
conditional long-run virtual blocking probability Pd = IP (B \ D = d), for each d = 0,1. Lemma 2 below 
characterizes Pq and P± based on the counting processes introduced above. Figure 2 gives a schematic 
representation of the two processes as observed a random customer arriving at t = 0. For clarity, we also 
use Na{-; A) to denote a Poisson counting process with a given rate A. 


Departure 

1 1 N 

l No \ 

l Ni 

Pre-arrival | 

-1 

r No 

0 

t Ni 1 

1 

r n, 

2 


Figure 2: One-class departure and pre-arrival processes 


Lemma 2. Consider the counterpart system with an infinite number of servers, if a customer arrives at 
time 0 in steady-state and requests service S = 1 deterministically to commence in D units of time (D = 0 
or 1 with probabilities 7 and 1 — 7 , respectively), the conditional virtual blocking probabilities are given by 

P 0 = P(B|D = 0)=P^max {jV 0 (l - r; A) + JVi(r; (1 - 7 )A)} >C 

Pi = P(B|£> = 1)=P(^ 1 (1;(1-7)A)>C'), 

where Nj (d = 0,1, 2) is a Poisson counting process with rate A d and Nd (d = 0, \) is the mirror image of 
Nd with the same rate A d- Moreover, Aq = A, Ai = (1 — 7 )A and A 2 = 0. 


Lemma 2 essentially tells us that the virtual blocking probability can be expressed in terms of the 
maximum of the sum of these two Poisson counting processes running towards each other (see Figure 3), 
one of which representing the pre-arrival process (the committed services not yet started) and the other one 
representing the departure process. The random process (inside the max operator) is hard to analyze, which 
is very different than merging two Poisson counting processes running in the same direction. 


No 

Departure 


max point 


Nl . 

Pre-arrival 


Pre-arrivals over [0,r] 
(present in system at time r) 


Departure over (r,l] 
(present in system at time r) 


0 


r 

(at the 4th occurance of Nj) 


1 


Figure 3: Two Poisson counting processes running towards each other 


To analyze these blocking probabilities, we first assume that the probability that an arriving customer 
seeks to start service immediately is positive (i.e., 7 > 0), and then drop this assumption later. Now assuming 
that 7 > 0 , we shall show that under the conventional heavy-traffic regime where both the arrival rate and 
the capacity scale together to infinity, i.e., C = A —> 00 , the conditional virtual blocking probabilities Pq and 
Pi have the following asymptotic limits, namely, lim^^oc Po = 1/2 and linr \_>. 00 Pi = 0. In fact, we shall 
prove a more general statement that will be useful in our analysis of the general case. 
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Proposition 1. Let Nq, Nq and be Poisson counting processes (mutually independent) with rates A, 6\X 
and ^2 A, respectively, where 1 > 9 \ > O 2 > 0 are fixed constants. Let Nq and N± be the mirror images of Nq 
and N\, respectively. Define two random variables X and Y as follows, 




max 

■ 6 [ 0 , 1 ] 


{7V o (l-r;A)+iV 1 (r;0 1 A)} 


Y 4 


max 

-€[ 0 , 1 ] 


{N 1 (l-r;e 1 X) + N 2 (r-e 2 X)Y 


( 1 ) 


Then, in the high-volume regime where C = A —> 00 , 


lim ¥(X > C ) 

A—>-oo 


1 

2’ 


lim P(Y > C) = 0. 

A—>-00 


Note that Po and Pi (in Lemma 2) can be obtained by simply setting 9q = (1 — 7 ) and 62 = 0 in X and 
Y above. We observe that asymptotically only customers with zero reservation time are likely to be blocked. 
This stems from the fact that for a given time slot and unit capacity, these customers are the last to arrive. 
Since we have a system where the accepted demand is close to the capacity, these are the customers that 
will most likely be blocked. 

To prove Proposition 1, we provide an alternative characterization of X and Y above based on a 
downward-drifting asymmetric random walk process that takes a down-step, for each departure, and an 
up-step, for each pre-arrival. We would like to show that asymptotically the maximum level of the random 
walk stays relatively close to its starting position by showing that the rate of the random walk going up is 
sublinear in y/X. 

Consider the merged process induced on [0,1] by the two Poisson counting processes No and W. Let 
J\f = iVo(1; A) + JVi(l; 6 X) denote the total number of occurrences (pre-arrivals and departures) over [0,1] of 
the two independent Poisson counting processes of Nq and Ni. Note that since Nq and N\ are independent 
of each other, J\f is a Poisson random variable with rate (1 + 9)X. Conditioning on A f = n, the induced 
merged process has n points uniformly distributed over the interval [0,1]. By the splitting argument applied 
to the merged process, each of these n points has independent probability p = ^ to be from 

the process Ni and probability q = 1 — p from the process Nq. If we associate +1 with each point from 
Ni, and —1 with each point from Nq, then each configuration of these n points induces a downward-drifting 
asymmetric random walk of length n. The random walk starts at the origin 0, with up probability p and 
down probability q. 

Lemma 3. Let lZ n denote the corresponding random walk of length n described above, and M n denote the 
maximum level attained by lZ n , and G n denote the overall number of down-steps taken by 1Z„. Also let 
X n = ( X | A f = n) with X defined in (1). Then, X n = G n + M n almost surely. 

However, it should be noted that M n and G n are correlated. To address the correlation between M n 
and G n , we will replace M n by M 00 . However, first we would like to obtain an expression for the hitting 
probability of a downward-drifting asymmetric random walk. This is done in Lemma 4 given below. (Lawler 
(2006) provided a proof in Chapter 2, Section 2.2; for completeness, we present a shorter proof.) 

Lemma 4. Consider a random walk defined by a sequence of independent random variables Ei = 1 with 
probability p and —1 with probability q = 1 — p. Let S n = Define M x £ [0, oo)(J{oo} to be 

maximum level attained by the random walk (i.e., = max„ S n ). Given that 0 < p < q < 1 (downward 

drifting), then the probability that the random walk ever hits above level b is P {M 00 > b) = ( p/q) b ■ 

We are now ready to prove Proposition 1 . 

Proof of Proposition 1. First we shall prove that lim^oo P(X > C) = 1/2. Let M a 0 be the maximum level 
attained by the infinite-step random walk defined above. Since the random walk has a negative drift, it 
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follows from Lemma 4 above that P(M oc > — logA/logf?) < 1/A. (Note that 9 < 1, so — logA/log0 > 0.) 
Now, we have 


P{X n >C) = P(G n + M n >C) 

= F(G n + M n >Cf]M n >- l ^j+F 


( 2 ) 


G„ 




< 


< 


< 


i 

A 


Si) 

log A A 

log6>, 

G n >C + 


M °°- log ej 




log A A 
loge)' 


The first equality follows from Lemma 3. The first inequality follows from the fact that > M n almost 
surely. The second inequality follows from Lemma 4 above. Since G n is distributed as (Nq( 1; A) | A f = n), 
we get from ( 2 ) that, 


P(X > C) = ^ C)P(AT = n) < y + J2 P ( G n > C + 


log A A = 1 
log 9 ) A 


log A 


= -+P(^V 0 (1;A)>C' + 
By virtue of Central Limit Theorem, we have 


lim P(X > C) < lim P ( Poisson(A) > C — 


log 9 

+ P ( Poisson(A) > C + 


log A 


P(Af = n ) 


log A A, 

loge )' 


A-s- 


A—> 

= lim P 

A—>oo 




log # -1 


^Poisson(A) > A — o('/\)j 




On the other hand, from the definition of X , it is clear that lim^oo P(A” > C) > lim^^oo P(lVo(l; A) > 
C) = limA-^oo P(Poisson(A) > A) = 1/2. 

Now, we are ready to prove the second part of Proposition 1, i.e., lim^oo P(Y > C) = 0. Since 
9\ G [0,1), we can always find a 9\ such that 9\ < 9± < 1. Then 9\ > 9\ > 0 2 , and define Y = 
max^rg q {lVi(l — r; $iA) + A^r; 02A)} . It is easy to see that Y stochastically dominates Y. Therefore, 
without loss of generality, we simply drop the bar of 9\ and Y. and assume that 62/61 = 9 < 1. Following 

the same argument above, we have P(Y > C) < y + P ^Poisson(0A) > A + , and again by virtue of 

Central Limit Theorem, we have 

lim P(Y > C) < lim P ( Poisson((9A) > C --—- ) 

A—Aoo A—Aoo \ log0 -1 / 


^lim P ^Poisson(0A) > A — o(a/A)^ = 0. 


This completes the proof. 


□ 


We have shown that if 0 < 7 < 1, lim^oo Po < 1/2, and limA-xxj Pi = 0. Now if 7 = 0, it follows that 
no arriving customer will start service immediately. Thus, we have liniA-^oo Pi = 1/2. 


3.2 The General Case 

Next we extend the simple model to allow for an arbitrary finite discrete reservation distribution D with 
marginal probability mass function fu(d). We still assume that the service distribution remains fixed at 
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5=1, deterministically. Now let /u(d) = 7 d for d £ [0, it], 0 < 7 ^ < 1 and J^d-i 7 d = 1- Lemma 5 below is 
a generalization of Lemma 1. 

Lemma 5. Consider the counterpart system with an infinite number of servers, a customer arriving at 
the system at time 0 in steady-state, observes that the pre-arrivals follow a non-homogeneous Poisson input 
process with piecewise rate rj(r) at time r 


V(r) 


A, if 

a(i-ELV‘^). v 


r < 0 , 
r > 0 . 
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Pre-arrival 

-1 
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l Ni , J 

l N 2 

T N 0 1 

u 1 

u 1 

P n 3 

0 

1 

2 
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Figure 4: One-class departure and pre-arrival processes with general reservation distribution 


Define Nd (for d £ [0,m]) to be the process of pre-arrivals prior to t over (d — 1 ,d). This process induces 
a departure process over the interval (d, d + 1], and let Nd denote its mirror image. Figure 4 shows the 
pre-arrival and departure processes with general reservation distribution. The conditional virtual blocking 
probabilities are given in Lemma 6 below, which is a generalization of Lemma 2. 

Lemma 6. Consider the counterpart system with an infinite number of servers, if a customer comes at time 
0 in steady-state and requests service (S = 1) deterministically to commence in D units of time (D £ [0,u]A 
the conditional virtual blocking probability is given by 

P d 4 P(B | D = d) ^ P ^ max {^(1 - r; A,) + JV d+ 1 (r; A d+1 )} > cj , Vd£[0,u], 

where N d is a Poisson counting process with rate X d = A ^1 — Y^i=o 7*) > an ^ ^d is a mirror image of N d 
with the same rate X d . 


Proposition 2 is a generalization of Proposition 1 with general reservation distribution. The traffic 
intensity p = X since the service distribution 5 = 1 deterministically. 

Proposition 2. Let the service distribution 5=1 deterministically, and the reservation distribution D 
be discrete with marginal probability mass function fo{d ) = ”f d and bounded support [0,it]. Let the index 
i = min{d : 7 ^ > 0}. Then, in the high-volume regime where C = p —> 00 , the conditional long-run virtual 
blocking probabilities 

lim Pi = —; lim P d = 0, for d £ [i + 1, u\. 

X—^oo 2 A—>-oo 


Next we extend the model further to allow for an arbitrary finite discrete service distribution. The total 
arrival rate is A, and the reservation distribution D is defined on [0, u] defined as in Section 3.2. Now assume 
that the service time 5 is a general finite discrete distribution on [1,?/]. More specifically, let fs(-) be the 
marginal probability mass function with /s(s) = P(5 = s) = n s , where K s = 1 and 0 < k s < 1 , for 

each s £ [ 1 , u]. 

We partition the arriving customers according to their requested service time, i.e., the customers are 
partitioned into v disjoint sets numbered 1,... ,v according to their requested service time. For each s £ [1, u], 
the arrival process of customers in set s follows a thinned Poisson process with rate n s X. Moreover, these 
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processes are independent of each other. Now, for each set s £ [1, u], let the conditional reservation probability 
mass function be P(D = d \ S = s) = 7 J for d £ [0,it]. Note that Y^d= 0 7 J = 1, for each s £ [1, v]. 

Consider the counterpart system with an infinite number of servers, if a customer of set s ( s £ [l,i>]) 
arrives at time 0 in steady-state and requests s units of service time to commence after d units of time 
( d £ [0, u ]), the conditional virtual blocking probability is defined as PJ = P(P | D = d, S = s). In addition, 
the traffic intensity is p = X]s=i sk s X = [iX, where /i = X}s=i SK s is the mean service time. 

Let iVj (for s £ [1, u] and d £ [0, it]) denote the pre-arrival process of set-s customers over (i.e., customers 
requesting s units of service time) the interval (d — s, d — s + 1]. This induces a departure process over the 
interval (d, d+ 1], and let iVJ denote its mirror image. The rate of iVJ ( and iVj) is given in Lemma 7 below. 

Lemma 7. Let 7VJ and iVJ be defined as above. Then, for each s £ [l,u] and each d £ [0, it], iVj and iVJ 
are Poisson processes with the same rate 


d—s 


A3 = AS { 1 - £ 7 ? = K S X l-£7* ■ 


i —0 


2—0 


Moreover, iVj is independent of iVj, for d ^ d' or s ^ s'. 
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Figure 5: Two-service-set departure and pre-arrival processes 


First assume that 3s £ [1, 17 ] such that 7 g > 0, i.e., the probability of an arriving customer requesting to 
start the service immediately upon arrival is strictly positive. This assumption can be dropped later. Let 
Ad be the maximum number of customers in the system over the interval (d, d + 1] for d £ [0, it]. In fact, 
one can derive an exact mathematical expression of each Ad for d £ [0,it], 

v d-\-s— 1 ( v v 

^ = EE iVai;AD+ max E^(l-pA^) + ^7Vj +s (r;A^)l. (4) 

s =2 i=d+ 1 ' e[ 1 l 8=1 S =1 J 


For r £ [0,1], the term ^“ = 1 1VJ(1 — r; Acaptures all the departures over (d + r, d + 1], the term 
E "=1 Nd + s ( r i Arf +S ) captures all the pre-arrivals over (d, d + r], and the term ES+i IV?(1; A|) cap¬ 

tures all the customers being served over (d, d + 1]. The sum captures exactly all the customers being served 
at time d + r. It is important to note that since Nf and Nf do not simultaneously appear in Ad, for each 
i £ [0, it] and s £ [l,u], all the Poisson counting processes in the expression of Ad are independent of each 
other (see Lemma 7). 

We shall further explain (4) by providing the following example when v = 2 (refer to Figure 5), 


Ao 

A\ 


IVi (1; A?) + max {^(1 - r; Aj) + IV 2 (1 

re[o,i] t 

IV 2 (1; Xl) + max {-ZVj^l - r; A}) + N?( 1 

r£[0,l] t 


r; A?) +Nl(r-, Aj) + N%(r; A|) j-, 


r\X\) + Nl(r\ A 2 ) + IVf (r; A§) j-, and so on. 
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More specifically, Aq represents the maximum customers in the system over the interval (0,1]. At time 
r G (0,1], the number of departures over (r, 1] is equal to iVg (1 — r; Aj) + N§(1 — r; Aq), capturing customers 
in both sets starting before 0 and still in the system at time r. (Note that the service time is at least 1.) 
In addition, the number of pre-arrivals over (0,r] is equal to N\ (r; A]) + JV|(r; A^), capturing pre-arrivals 
of customers with service time 1 and 2, respectively, starting service over (0,r]. Finally, Nf captures set-2 
customers with service time 2 who started service within (—1,0]. These customers will continue service over 
the entire interval (0,1]. Therefore Nf( l;Af) appears in the expression Aq outside the max. The same 
reasoning applies to A;, for each i G [l,it]. 

Now for each d G [0,u] and s G [l,i>], we have PJ = P(max(A,j,... ,Ad+ s -i) > C). It should be noted 
that Ad and A# can be correlated. To analyze the limiting behavior of P?, we first analyze the limits of 
IP (Ad > C), for each d G [0,u]. 

Lemma 8. Assume that there exists s G [l,u] such that 7 q > 0. Let Ad he defined as in (f). The traffic 
intensity is p = Y^s=i SKs Then, we have 

lim P(Ao > C) = —; lim P (Ad > C) = 0, for d G [l,u]. (5) 

A—>oo 2 A—>-oo 

Proposition 3. Let the service distribution S be discrete with marginal probability mass function /s(s) = k s 
and bounded support [l,i;], and the reservation distribution D be discrete with marginal probability mass 
function fo{d) = "fd and bounded support [0, u]. The traffic intensity is given by p = X)s=i SK sA = ^“ =1 s ^o- 
Let the index i = min{d : yj > 0 for some s G [l,u]}. Then in the high-volume regime where C = p —^ oo, 
for each s G [l,u], the conditional long-run virtual blocking probabilities 

lim Pf = lim Pj =0, for d G [i + 1, u]. (6) 

A—>-oo z A—^oo 

3.3 Discussions of Our Results 

For each k = 1,..., M, let Qdsk be the stationary blocking probability of class -k customers with reservation 
time d and service time s, i.e., the stationary probability that a customer of such type arrives at a random 
time to the system and is rejected due to insufficient capacity at some point within the requested service 
interval. Note that the blocking probability Qdsk is well-defined since the corresponding underlying stochastic 
process is Ergodic (see the technical proof in the Appendix). Let A dsk — AfcP(Dfc = d,Sk = s) be the arrival 
rate of class-fc customers with reservation d and service s. Then, the expected long-run average reward rate 
collected can be expressed as Yld,s r k^dskj{fi - Qdsk)- 

If we merge the M -class arrival processes, the merged arrival process has an aggregate rate A = 
and a customer upon arrival has probability of A*,/A to be a class-fc customer. Define v = maxt^ and 
u = maxfcUfc. Let S (discrete with finite support [l,v] and mean p) and D (discrete with finite support 
[0,u]) be the merged service and reservation distributions. The joint probability mass function of S and D 
is fD,s(d, s) = P (D = d,S = s) = J^kLi it ' I P(L>k = d,Sk = s ), for d G [0,u] and s G [l,v]. Similarly, 
the marginal probability mass functions of S and D are fs(s) — P(S = s) = = s ) an b 

fo(,d) = P (D = d) = J2kL l ' ^(Dk = d), respectively, for s G [0, it] and d G [l,u]. It is sufficient for the 
analysis to use only the marginal probability mass functions. This allows for arbitrary correlation between 
the reservation and service distributions of a given customer. 

Proof of Theorem 1. Theorem 1(a) follows directly from Proposition 3. Theorem 1(b) follows the identical 
arguments (by changing p = (1 — e)C everywhere) from Propositions 1, 2 and 3. □ 

Theorem 1 provides the first asymptotic analysis on the blocking probabilities in loss network systems with 
discrete advanced reservation and service distributions. The performance analysis (on blocking probabilities) 
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is completely different from the one used in Levi and Radovanovic (2010) for models without advanced 
reservation. In the following, we also discuss the key distinction of our results from two related models. 


Key Distinction from the Models without Advanced Reservation. In contrast to models without 
advanced reservation (e.g., Levi and Radovanovic (2010)), the major challenges in analyzing the blocking 
probabilities in loss network systems with advanced reservation is that the blocking event depends on the 
maximum reserved capacity over a particular requested service interval. This requires the characterization 
of the booking profile (i.e., the pre-reserved arrival and departure processes) over the service interval. As 
a simple example with capacity C = 2 shown in Figure 6, in the models without advanced reservation, it 
suffices to check the instantaneous load of the system upon arrival of a customer. However, in the models 
with advanced reservation, we cannot guarantee one’s request by merely checking the instantaneous load of 
the system at her starting service time upon her arrival, because her request may be potentially blocked by 
reserved slots of those customers who booked prior to her but will start services after her. (In this simple 
example, the system has only 1 customer in service when her service begins; however, during her requested 
service interval, there is a point in time that the system has 3 customers (who were reserved before her). 
Thus, she has to be rejected by the system.) This introduces much difficulties in handling this correlation 
issue between the incoming requests and the booking profiles. 


Models without Adv. Res. - suffices to check the instantaneous load 


C = 2 

pre-arrivals 



arrival requested service 


i 


point of check 

Model with Adv. Res. 

- needs to scan the entire service interval 

•- 

C = 2 


pre-arrivals • 

• - 


arrival requested service 

time -•- 

dk s k 


interval of check 


Figure 6: Challenges in analyzing the blocking probabilities in loss queues with advanced reservation 


Key Distinction from the Tandem Queues of Two Stations. Tandem queueing model is closely 
related to our model since one may regard the original system with advanced reservation as a tandem 
queueing model of two stations, where the advance reservation is spent in the first station and the service is 
spent in the second station. The first station has infinite capacity and the second station has finite capacity, 
customers first enter the system from the first station, but if the second station is full when customers arrive, 
they will be rejected or lost. Note that the decision whether a customer is blocked is made only after the 
service in the first station is over. However, in our model, we have to make the decision as soon as the 
customer enters the first station. The critical difference is that in the tandem queueing model it suffices 
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to check the instantaneous load of the second station to determine if the customer is blocked, while in our 
model we have to check the maximum occupancy over the entire requested service interval as seen from 
the moment the customer arrives. When we relax the finite capacity assumption on the second station, the 
blocking probability can seemingly be approximated by the probability that the number of customers in the 
second station is bigger than C (see, e.g., Boxma (1984), Schmidt (1987)). However, this approximation 
cannot be used to upper bound the blocking probabilities in our system due to the difference in system 
dynamics. It may serve as an approximation of the blocking probabilities but we are unsure how good the 
approximation is, since the stationary distribution can no longer be expressed as a product-form. 


4 Applications in Revenue Management 


Model. Next we show how the theoretical results obtained in Section 3 can be used to design and analyze 
provably near-optimal policies for core revenue management models. In particular, we focus our attention 
on models concerned with revenue management of reusable resources, such as hotel room management , car 
rental management and workforce management. In all of these settings, customers arrive and seek to book 
resources some time in advance. Moreover, after a resource unit finishes serving a customer’s request, it can 
be used to serve other customers. The objective is to design an admission control policy that optimizes the 
expected long-run average revenue rate. 

We consider a single pool of resources of integer capacity C < oo that is used to satisfy the demands of M 
different classes of customers. The customers of each class k = 1,..., M, arrive according to an independent 
Poisson process with respective rate A&. Each class -k customer requests to reserve one unit of the capacity for 
a specified service time interval in the future. Similar in Section 2, we let Dk be the reservation distribution 
of a class-fc customer, and Sk be the respective service distribution with mean /at- During the time a customer 
is served, the requested unit cannot be used by any other customer; after the service is over, the unit becomes 
available again to serve other customers. If the resource is reserved, the customer pays a class-specific rate of 
ffe dollars per unit of service time. The resource can be reserved for an arriving customer only if upon arrival 
there is at least one unit of capacity that is available (i.e., not reserved) throughout the entire requested 
interval. Specifically, a customer’s request can be satisfied if the maximum number of already reserved 
resources throughout the requested service interval is smaller than the capacity C. However, customers 
can be rejected even if there is available capacity. Rejecting a customer now possibly enables serving more 
profitable customers in the future. Customers whose requests are not reserved upon arrival are lost and 
leave the system. The goal is to find a feasible admission policy that maximizes the expected long-run 
average revenue. Specifically, if TZ n (T) denotes the revenue achieved by policy 7r over the interval [0,T], 
then the expected long-run average revenue of n is defined as lZ(n) = lim inf 7-^00 (^[7^ (T)]/T). where the 
expectation is taken with respect to the probability measure induced by 7r. 

Like many stochastic optimization models, one can formulate this problem using dynamic programming 
approach. However, even in special cases (e.g., no advanced reservation allowed and with exponentially 
distributed service times), the resulting dynamic programs seem computationally intractable because the 
corresponding state space grows very fast. This is known as the curse of dimensionality. Thus, finding 
provably good policies is a challenging task. 


An Improved Class Selection Policy. Next we describe a simple linear program (LP) that provides 
an upper bound on (1 — e) times the achievable expected long-run average revenue for every small posi¬ 
tive e. The LP conceptually resembles to the one used by Levi and Radovanovic (2010), Key (1990) and 
Iyengar and Sigman (2004) who study models without advanced reservation. It is also similar in spirit to 
the one used by Adelman (2007) in the queueing network framework with unit resource requirements again 
without advanced reservation. We shall show how to use the optimal solution of the LP to construct a simple 
admission control policy that is called improved class selection policy (ICSP). The original class selection 
policy was first analyzed by Levi and Radovanovic (2010) in models without advanced reservation. 
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At any point of time t, the state of the system is specified by the entire booking profile consisting of the 
class, reservation and service information of each customer in the booking system as well as the customers 
currently served. Without loss of generality, we restrict our attention to state-dependent policies. Note that 
each state-dependent policy induces a Markov process over the state-space. Moreover, by following similar 
arguments as in Lu and Radovanovic (2007) and Sevastyanov (1957), one can show that the induced Markov 
process has a unique stationary distribution which is Ergodic (see the detailed proof in the Appendix). 
Since any state-dependent policy induces a Markov process on the state-space of the system that is ergodic, 
for a given state-dependent policy n, there exists a long-run stationary probability a^ sk for accepting a 
class-fc customer who wishes to start service in d units of time for s units of time, which is equal to the 
long-run proportion of accepted customers of this type while running the policy 7 r. In other words, any 
state-dependent policy 7r is associated with the stationary probabilities cx^ sk for all possible reservation time 
d , service time s and class k. The mean arrival rate of accepted class-fc customers with reservation time d 
and service time s is ct^ sk \dsk- By applying Little’s Law and the PASTA property (see Gallager (1996)), 
the expected number of class -k customers with reservation time d and service time s being served in the 
system under state-dependent policy ir is ct^ k Xijkj. It follows that under policy 7r the expected long-run 
average number of resource units being used to serve customers can be expressed as XX j a ijk^dskS. 

Fix a small e < minfc(A kP-kC -1 ), this gives rise to the knapsack LP below: 

M 

EE rkOdsk^dskS, (7) 

k—1 d,s 
M 

EE a dsk^dskS < (1 — e)C, 

k—1 d,s 

0 < a ds k < 1, Vd, s, k. 

Note that for each feasible state-dependent policy 7 r, the vector a* = {a^ sfc } is a feasible solution for the LP 
with objective value equal to the expected long-run average revenue of policy 7r. 

Lemma 9. Let {a)j sfc } be the optimal solution of (7). Then the optimal objective value of (7) is at least 
(1 — e) times the optimal expected reveune, i.e., 

M 

E E r * a *dsk*dskS > (1 - e)H(OPT). 

k= 1 d,s 

The LP defined in (7) can be solved greedily. Without loss of generality, assume that classes are re¬ 
numbered such that ri > V 2 > ■ ■ ■ > tm- Then the optimal solution to (7) is as follows: there exists a class 
M' < M such that a* = ... = = 1) a *M' = 1 — cC(Xm'Pm') -1 , ol * m , + 1 = • • ■ = ot* M = 0- This solution 

from solving the LP gives rise to the ICSP: 

(1) For each k — 1,..., M 1 — 1, accept the customer upon arrival if there is sufficient unreserved capacity 
throughout the requested service interval. 

(2) If k = M\ accept with probability 1 — cC{Xm 'if there is sufficient unreserved capacity throughout 
the requested service interval. 

(3) For k = M' + 1,..., M, reject. 

The ICSP is conceptually simple in that it splits the classes into profitable and nonprofitable that should be 
ignored. In fact, we can assume, without loss of generality, that there is no fractional variable in the optimal 
solution a*, i.e., for each k = 1,... ,M', a k = 1. (If a* M , is fractional, we think of class M' as having an 
arrival rate X' M , = ch* m ,Xm' and then eliminate the fractional variable from a*.) 


max 

a dsk 

s.t. 
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Since the ICSP accepts the profitable classes 1 to M' and rejects the nonprofitable classes M' + 1 to 
M, it induces a well-structured stochastic process called loss network systems with advanced reservation 
analyzed in Section 3. Each class k = 1,..., M induces a Poisson arrival stream with respective rate cx^Xk, 
1 < k < M. Thus, for each class k with = 1, the arrival process is identical to the original process, each 
class k with af, = 0 can be ignored. This gives rise to system dynamics analogous to the loss network model 
with advanced reservation defined in Section 3. The key aspect of performance analysis of the ICSP boils 
down to finding an upper bound on the blocking probabilities in these loss network models. 

Proof of Theorem 2. The expected long-run average revenue of the ICSP is Ed s r kXdsks( 1 — Qdsk ), 

where Qdsk is the stationary probability of blocking a class-fc customers with reservation time d and service 
time s. However, Efcli Ed s r kXdskS is the optimal value of the LP defined in (7), which is an upper bound 
on (1 — e)lZ(OPT) for small positive e by Lemma 9. Thus, a key aspect of the performance analysis of the 
ICSP is to obtain an upper bound on the probabilities Qdsk’ s. Specifically, if 1 — Qdsk > £, for each d, s, 
and fc, then 

M' M' 

TZ(ICSP) = EE 1 Qdsk ) E EE r k X ds kSti>ai-£WOPT). 

k— 1 d,s k— 1 d,s 

By Theorem 1(b), we know that £ —> 1 as p —> oo. This completes the proof. □ 


5 Pricing Extensions 


We present an interesting pricing extension, in which the arrival rates of the different classes of customers 
are affected by prices. Specifically, consider a two-stage decision. At the first stage, we set the respective 
prices ri,..., tm for each class. This determines the respective arrival rates Ai(ri),..., A(The rate 
of class-fc customers is affected only by price r k .) Then, given the arrival rates, we wish to find the optimal 
admission policy that maximizes the expected long-run revenue rate. In particular, we assume that A k{fk) 
is nonnegative, differentiable, and decreasing in r k for each 1 < k < M. In addition, we assume that all 
prices are nonnegative real numbers and that there exists a price Too such that, for each i = k,, M, we 
have Afc(roo) = 0. (The latter condition is required to guarantee that the problem has an optimal solution.) 

For the model with price-driven demand we use the following nonlinear program (NLP1): 


max 

&dsk 


s.t. 


M 

EE T'k&dsk^dsk 

k—1 d,s 
M 

EE OtdskXdsk{l'k)s < (1 - e)C, 

k= 1 d,s 

0 < a ds k < 1, Vd, s, k, 

0 < r k < 1, Vfc. 


( 8 ) 


In particular, it can be verified that any optimal solution of (NLP1) has only nonnegative prices. Also, 
observe that for any fixed prices ri,... ,tm, the corresponding solution of {adsk} has the same knapsack 
structure defined in Section 4 above. Let (r*,a*) = {r k ,adsk} be the corresponding optimal solution. Note 
that if one can solve (NLP1) and obtain the solution (r*,a*) then one can construct a similar ICSP that 
will be amenable to the same performance analysis discussed in Section 3 above. However, solving (NLP1) 
directly may be computationally hard. Next, we show that one can reduce (NLP1) to an equivalent nonlinear 
program that is more tractable; we denote it by (NLP2). (By equivalent we mean that they have the same 
set of optimal solutions.) Consider the following nonlinear program (NLP2): 
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(9) 


M 

max V' V' r k X ds k (r k ) j, 

r k z — / z " 

k=l i,j 

M 

^ EE A dsk(r k )s < (1 - e)C, 

k =1 d,s 

0 < r fc < 1, Vfc. 

It can be readily verified that as long as A dsk{i~k) is nonnegative (and decreasing) it is always optimal to 
have nonnegative prices, so the nonnegativity constraints can be dropped. 

Theorem 3. The programs (NLP1) and (NLP2) are equivalent. 

Proof of Theorem 3. First, we show that for each solution {rk} of (NLP2), we can construct a solution of 
(NLP1) with the same objective value. Specifically, consider a solution {r' k ,a' dsk } such that r' k = rk and 
a'dsk = 1 if and only if }P d s A d sk{rk)s > 0. It can be verified that the resulting solution is feasible for (NLP1) 
and has the same objective value. 

Next, we show how to map optimal solution { r k , a* dsk } of (NLP1) to a feasible solution of (NLP2) with the 
same objective function. For each k = 1,..., M' — 1, set r*, = r k , and for each k = M' + 1,..., M, set rk = Too- 
It is clear that, for each k ^ M ', the resulting contributions to the objective value and constraint in (NLP2) 
are the same as in (NLP1). Consider now the possible fractional value a* M , for class M'. The respective 
contribution of class M' to the objective value is J2d s r M ,a dsM'^ijM' ■ Similarly, the contribution to 

constraint in (7) is J2 d s a dsM / ^dsM , {f'Mt)s. Thus, it is sufficient to show that there exists a price rM' such 

that Y,d,s r M'^dsM'{r M ')s > I2d,s r *M' a *dsM' X dsM'(r* M ,)s and Ed, s ^dsM' {r M ')s < a dsM'^dsM'{r* M ,)s. 

Since J2 d ,s r *M’^dsM'{r* M ,)s > J2 d , s r *M’ a *d S M’^dsM'{r* M ,)s, by the properties of \ ds M' [r M '), we know that 
there exists f S [r M ',r oo) such that J2 d , s r\d S M' {r)s = J2 d ^r* M ,a* dsM ,X ds M'(r* M ,)j. Note that f > r* M ,, and 
therefore we obtain J2d,s r M'^d S M'(r)s < Y,d,s f ^dsM'(r)s = J2 d ^r* M ,a dsM ,\ dsM '{r* M ,)s. We conclude that 
J2d,s A dsM' ( f)s < J2d,s u*dsM'^dsM' ( r* M ,)s , which completes the proof. □ 

Lemma 3 implies that we can solve (NLP2) instead of solving (NLP1). However, (NLP2) is compu¬ 
tationally more tractable and can be solved relatively easy in many scenarios. Specifically, Lagrangify 
(dualize) the constraint in (NLP2) with some Lagrange multiplier 0 and consider the unconstraint problem 
max rfcg [Q r . oo ) Si <k<M Sd s ( r fc ~ ©)Ad s /c(rfc)s, which is separable in r i,..., Tm 1 ■ In fact, one aims to find the 
minimal 0 for which the resulting solution satisfies the constraint in (NLP2). This can be done by applying 
bi-section search on the interval [0,poo]. The complexity of this procedure depends on the complexity of 
maximizing Si < k <M Sd s( r fc — 0)A d sk(i"k)s for each 1 < k < M. It is not hard to check that there are at 
least two tractable cases: (i) Adsfc^fc) is a concave function on [0,Too), for each 1 < k < M; (ii) A ds k(fk) is 
convex, but rk\ d sk{fk) is concave function on [0, Too), for each 1 < k < M. 


6 Numerical Experiments 


In this section, we examine the empirical performance of the ICSP in comparison with the optimal solutions 
via dynamic programming. It should be noted that the dynamic program is computationally expensive 
and we have to restrict ourselves to 3 classes of customer arrivals. In contrast, solving the ICSP solutions is 
extremely efficient and the results show that the performance gap is very small under a large set of instances. 
The numerical studies also suggest that the ICSP performs close to optimal in light and medium traffic as 
well. For all tested instances, the average CPU time per test instance on a Pentium 2.70GHz PC is 4.5s, 
whereas the dynamic programming algorithm is extremely slow per test instance. 
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Dynamic Programming Formulation. We describe the dynamic program used to compute the optimal 
policies. Incoming requests arrive over a time horizon of T discrete periods. The state variable is the 
remaining capacity for each period c = (ci, C 2 ,..., Ct) t ■ Initially, c = (eg, eg, ■ ■ ■, cg) T where eg is the 
maximum capacity of the homogeneous resource pool. The reward for different classes of customers r = 
(Vi, f 2 ,..., Tm) T where M is number of classes. Their arriving probability is A = (Ai, A 2 ,..., A m) T according 
to Poisson processes. The booking slot or the advanced reserved slot is defined as a Kronecker delta vector 
w = S a b, that is, w(i) = l,Vz € [a, b] and w(i) = 0 otherwise. The vector w represents the arriving request 
by flagging each of its requested service period 1 between the starting service time a and ending service time 
b. 


The value function is defined as follow. At the beginning of time t, with remaining capacity c, the optimal 
expected cumulative reward one could get is EV) C = sup 7rgn {E(I^ c |7r)}. It turns out that the optimal decision 
follows a threshold rule: 


7T*(f,c,w,r) 


accept, if re T w + EV^_ 1 U ' > ¥.V£ +1 and w < c, 

reject, if re T w + < EV^ or w < c doesn’t hold, 


where e is a column vector of all ones, and w < c component-wise means that the remaining capacities can 
serve the incoming request. The bellman update is then 


EV t c 


P(re T w + EV t c ~! W > Ek t c +1 ,w < c) ■ E(re T w + EVJ'jT” | w < c, re T w + E> EV^) 
+ (1 - P(re T w + EF t c + -“ > EC t c +1 , w < c)) • EF t c +1 , 


with boundary condition E V t c = 0, Vc and t > T. No arrival is considered rejected arbitrarily. We then 
define critical reward: 

RW = { EVtC+1 - EK+r ' W - C 

I 00 , otherwise 


Notice Rt{w) is a nondecreasing function of w for all t and c. The optimal decision rule can re-written as 
follows, 


7r*(f, c, w, r) 


accept, if re T w > Rt(w), 
reject, if re T w < Rt(w). 


The resulting dynamic program suffers from the curse of dimensionality due to the multidimensional state 
vector. 


Numerical Results. We consider three classes of customers. The default parameters (the base case) are 
as follows, 


A = 30, (Ai, A 2 , A 3 ) = (0.1A, 0.45A, 0.45A) 
r = (15,10,8), C = 60, T = 120. 

The advanced reservation and service distributions are assumed to be discretized exponential or normal 
distributions with different coefficient of variations ( c.v. = 0.1,0.25,0.5). We benchmark the empirical 
performance of ICSP (with e = 0.001) against the optimal dynamic programming solution. The extensive 
numerical results show that the ICSP performs within a few percentages of the optimal revenue. We define 
the performance measure of the ICSP as 

H(ICSP) - 7 Z{OPT) 

PIT — --- 

K(OPT) 

Table 1 shows the numerical results with sensitivities on the mean advanced reservation times v or the mean 
service times [i . Table 2 shows the numerical results where the total capacity is scaled or unsealed with the 
arrival rate. It should be noted that the performance gap shrinks when the capacity C increases, which is 
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consistent with our analytical analysis. Finally, Table 3 shows the numerical results with sensitivities on 
the reward vector or the arrival probabilities. The results indicate that the performance gap is robust with 
respect to these input parameters. The typical performance of the ICSP is within 7% of optimal ((average 
error of less than 4%) in all test instances. 


V 

DP 

err 

Accept 


DP 

err 

Accept 


(10 6 ) 


Prob. 


(10 6 ) 


Prob. 

p, = 8 

v = 8 

2 

6.99 

1.78% 

(1, 0.44, 0) 

2 

5.51 

1.02% 

(1, 1, 0.56) 

4 

6.79 

1.26% 

(1, 0.44, 0) 

4 

5.63 

2.60% 

(1, 0.91, 0) 

6 

6.59 

2.37% 

(1, 0.44, 0) 

6 

6.13 

3.11% 

(1, 0.58, 0) 

8 

6.35 

2.81% 

(1, 0.44, 0) 

8 

6.35 

2.81% 

(1, 0.44, 0) 

10 

6.21 

3.73% 

(1, 0.44, 0) 

10 

6.67 

3.10% 

(1, 0.36, 0) 

12 

6.19 

4.89% 

(1, 0.44, 0) 

12 

6.79 

3.87% 

(1, 0.32, 0) 


Table 1: Performance of ICSP: changing the mean advanced reservation times v or the mean service times 
M- 


C 

DP 

(10 6 ) 

err 

Accept 

Prob. 

C 

DP 

(10 6 ) 

err 

Accept 

Prob. 

A = 30 

C = p* 

30 

3.66 

6.51% 

(1 

0.11, 0) 

22 

2.16 

6.43% 

(1, 0.61, 0) 

40 

4.51 

6.99% 

(1 

0.22, 0) 

44 

4.53 

3.76% 

(1, 0.61, 0) 

50 

5.45 

3.54% 

(1 

0.33, 0) 

66 

6.91 

2.27% 

(1, 0.61, 0) 

60 

6.35 

2.83% 

(1 

0.44, 0) 

88 

9.29 

2.38% 

(1, 0.61, 0) 

70 

7.39 

2.42% 

(1 

0.55, 0) 

110 

11.8 

1.20% 

(1, 0.61, 0) 

80 

8.41 

1.27% 

(1 

0.66, 0) 

132 

14.1 

0.38% 

(1, 0.61, 0) 


Table 2: Performance of ICSP: changing the total capacity C (unsealed and scaled). 


r 

DP 

err 

Accept 

Arrival 

DP 

err 

Accept 


(10 6 ) 


Prob. 

Prob. 

(10 6 ) 


Prob. 

Arrival Prob. = 

(0.1, 0.45, 0.45) 

r 

= (15, 

10,8) 


(20, 10, 1) 

3.66 

1.80% 

(1,0.11,0) 

(0.1, 0.3, 0.6) 

6.42 

1.97% 

(1, 0.66, 0) 

(20, 10, 8) 

4.51 

1.86% 

(1, 0.22, 0) 

(0.1, 0.45, 0.45) 

6.35 

2.81% 

(1, 0.44, 0) 

(80, 10, 5) 

5.45 

1.59% 

(1, 0.33, 0) 

(0.05, 0.87, 0.08) 

6.04 

3.60% 

(1, 0.28, 0) 

(100, 10, 5) 

6.35 

2.35% 

(1, 0.44, 0) 

(0.1, 0.82, 0.08) 

6.51 

3.77% 

(1, 0.24, 0) 

(150, 10, 5) 

7.39 

0.63% 

(1, 0.55, 0) 

(0.3, 0.62, 0.08) 

8.27 

2.56% 

(1, 0.00, 0) 


Table 3: Performance of ICSP: changing the reward vector r or the arrival probabilities. 


7 Conclusion 

To close this paper, we would like to point out three potential research directions, (a) One may consider 
a dynamic pricing model and derive similar policies. Assume that there is a single-class time-homogenous 
Poisson arrival process with rate A. Each customer’s reservation and service-time are drawn from D and S , 
respectively. The system offers a price from a fixed price menu [r*i,..., r n \ to an arriving customer with d 
and s, depending on the current state. The state is characterized by the booking profile, d, and s. Moreover, 
one can introduce a reservation price distribution denoted by R. The customer only accepts the offer if the 
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price offered falls below the reservation price, (b) Gallego and Hu (2014) considered a competition network 
model of perishable resources. One could also study a counterpart model of reusable resources. Each firm 
has a fixed capacity of reusable resources and competes in setting prices to sell them. Assuming deterministic 
customer arrival rates, one can potentially show that any equilibrium strategy has a simple structure, and 
then show that there exists a similar asymptotic equilibrium strategy in a stochastic version where the arrival 
rates and the capacity are scaled together to infinity, (c) To capture seasonality of demands, one could also 
consider the model studied in this paper with non-homogeneous Poisson arrivals. However, this may require 
entirely different methodologies. 
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Appendix 

Proof of Ergodicity 

In this section, we prove the existence and uniqueness of stationary distribution for the Markov chain induced 
by the improved class selection policy (ICSP). Let requests for resources from a common resource pool of 
capacity C < oo arrive at time points {r n , —oo < n < oo}. By observing the system at the moments of 
request arrivals, we define a discrete time process I n = (Nn C \ L i: D i: Si,i = 1,2,... N^) where N^ is 
the number of active (reserved) requests in the system at the moment of nth arrival r n , Li is the elapsed 
time from the arrival of the i th request to r n , Di and Si represent the reservation time (between arrival and 
actual service) and service time of the i th request, respectively. Note that Li < Di + Si for i = 1,2,... N^\ 
The discrete-time Markov chain I n describes the entire booking profile at the moment of nth arrival r„. 
We use a discrete version of Theorem 1 in Sevastyanov (1957) to prove the existence of a unique stationary 
distribution for {/„}, which we state next for completeness. 

Theorem 4. A Markov chain homogeneous in time has a unique stationary distribution which is ergodic if, 
for any e > 0, there exists a measurable set S, a probability distribution R on LI, and n\ > 0, k > 0, K > 0 
such that 

• kR(A) < P ni ( x, A) for all points x £ H and measurable sets A C H; for any initial distribution Pq 
there exists no such that for any n > no, 

• PJH) >l-e, 

• P n (A) < KR(A) + e for all measurable sets A C H. 
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Proof of Ergodicity. The proof follows similar arguments as in Lu and Radovanovic (2007) and Sevastyanov 
(1957). Define set H{a,b,c,d) as 

H(a, b , c, d) = {AK C) < a, 0 < < b, 0 < A < c, 0 < Si < d} , (10) 

for some positive finite constants a,b,c,d. Now we show that for any e > 0, there exists H{a,b,c,d) £ f2, 
such that for any initial distribution Pq there exists n o such that for all n> no, 

P n (H(a, b, c, d)) > 1 — e. (11) 


Note that 


P n (H(a,b,c,d)) < 


4*2 > a 


U {Li>b}, N Q< 


i£N, 


(C) 

0 , n 


( 12 ) 


+P 


U {D i >c},N$< 


i&N, 


(C) 


U {Sr>d},N$< 


i£N, 


(C) 

0 , n 


< 


42+Kn> a 


+ aP [Li > b] + aP [Di > c] + aP [Si > d] 


(C) 

where Nf n represents the number of active requests at r n that originated from n arrivals at tq, ..., r n _i, 
and the rest of active requests at t„, n = Nq C J — Na°J are those that were active at the initial point r 0 
and are still active in the system at the moment of nth arrival. Next, since 


+ iV 0 ° n > a 


(13) 


< 


< 


a 

a,n > 2 


Ni c J > 


Kn > | 


< 


n(°°) 


> 


N° 


E 1 [D°i + S°i > T„ - to] > 




7V(°°) 


> 


+ E P Kn =m) p 


m —0 


^l[£>? + S?>(l-c 1 )nE(r 1 -7 l ,)] 


> 


.*= l 


+P [r„ - T 0 < (1 - ei)nE(ri - r 0 ))] , 


where 0 < ei < 1 is an arbitrary constant and we used > 42 a.s. where is the active requests 

under infinite capacity system. 

Next we prove that there exists a = ao large enough such that (13) is bounded by e/4. By virtue of 
Little’s Law, we know that ETV^ 00 - 1 < oo and therefore, uniformly for all n > 0, 


lim P 

a—too 


7V (o 


> 


2 J 


—s- 0. 


(14) 


Next, note that 1 [D® + S® > (1 — ei)nE(ri — r 0 )] < 1 [D° + Sf > (1 — ei)E(ri — r 0 )] a.s., and that for any 
fixed to, 


< 


E 1 [ D i + > (1 - ei)nE(ri - r 0 )] > ■ 

. i 

m 

E 1 K + S ° > (! - - T «)] > ? 


( 15 ) 


4, 0 as a —> oo, 
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which by the monotone convergence theorem implies that, uniformly for all n > 0, 


m 

E 1 [D°i + > (1 - ci)nE(n - r 0 ) 

.i =1 


lim E P [Nq = m 

a—too z ' L ’ 

m —0 L «—1 

Finally, by the Weak Law of Large Numbers, for all n large enough, 

P [r n - r 0 < (1 - ei)nE(ri - r 0 ))] < e/12. 

Thus, by (14) and (15), for an arbitrary 0 < e < 1, there exists no < oo and ao < oo 

< e/12, 


for all n > no, 

and 


' N. £»> > ^ 

. 71 2 J 


(17) 

large enough such that 

(18) 


OO 

J2 P iKn = 

m —0 


ml P 


m 

E 1 i S ° + D ° > (! - £ i) nE ( T i - T °)] > y < e/12. 

.i=l 

, there exists bo, cq and do such that 


m=u |_2=i 

Now since EP^ < oo, ED, < oo and ES) < oo 

,|S 4^’ P[D<>e 0 ]<j^, p|s * >tio1 - 4^ 


“ > bol ^ 4ao , 


Thus, by (17), (18), (19) and (20), we have 

P n (H(a,b,c,d)) < 


P n (H(a,b,c,d)) > 1 - e. 


(19) 

( 20 ) 

( 21 ) 


Next, we show that there exists n\ > 0 and k > 0 such that for all points x £ H(ao,bo,co,do) and 
measurable sets A £ ff(ao, &o, Co, do), the following inequality holds 

P ni (x,A) > kR(A). (22) 

Let Fv(v) denote a cumulative distribution function of a random duration V, i.e. P [V < t/|. Next, for any 
ni, 

P ni (x,A) > P 1 (x,ui 0 )Pn 2 {^o,A) 1 (23) 

where n 2 = ni - 1. Let x = (m, h ,..., l m ,di, ■. ■ ,d m , Si,..., s m ) £ H(a 0 , b 0 , c 0 , d 0 ). Then, 

Pi (a;, wo) > P[ri — ro > A, all m requests depart in (t 0 ,ti)] (24) 

> P [n - r 0 > co + d 0 ] = 1 - P Q (c 0 + d 0 ) = e ~ Kco+do) , 

where F a (u) represents cumulative inter-arrival distribution of a renewal process {r„}, i.e. 

F a (u) = P [n - r 0 < u] 

. Next, we derive a lower bound for P n2 (u>o,A) for some n 2 large enough such that 

P [t„ 2 - r 0 > c 0 + d 0 ] > 1 - (25) 

Note that the condition imposed on n 2 is possible due to the Weak Law of Large Numbers, since for any 
e > 0 and all n 2 large enough with Co + do < (1 — e)E(r n2 — To), 


’ [Tn 2 - To > c 0 + do] > P [r„ 2 - To > (1 - e)E(r„ 2 - r 0 )] > 1 - 


(26) 


Next, pick any x' = {m ', l[,... l' m ,, d[,... d' m ,,s[,... ,s' m ,) £ A. Define x' + dx 1 = {ml[ + dl[,... l' m , + 
dl' m i , d[ + dd[,... d' m , + dd' m ,,s{ + ds[, ...,s' m ,+ ds' m ,) where dl [,..., dl' m ,, dd [,..., dd' m ,,ds ' 1: ..., ds' m , are 
infinitesimal elements. Then the transition probability into state (x 1 , x' + dx') starting from wq can be lower 
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bounded by the probability of the event that there are exactly m' arrivals between t\ and r „ 2 whose arrivals 
times are determined by (r n2 — /' — d/', t „ 2 — I'f) for i = 1 ,..., m', and none of these m' arrivals concluded 
at time r „ 2 and there were no other arrivals. Therefore, 


(w 0 , (x' + dx')) > e~ XTn2 —■ TT[1 F D+S D ,s(k, di , s,)] 

m'\ ■ LA 


(27) 


where Fd+s,d,s(') is the joint cumulative probability mass function. Now define probability distribution 


r \ m y 

i?(A) = r/ / —— ]^[ [1 - .F.D+s,.D,s(Z*,d*,Si)], 

Jx'eA m ■ j=1 

where ^ is a normalization constant. Thus, we have 

P n2+1 {x,A) > e - A(co+do+r ^V- 1 i?(A). 


(28) 


(29) 


Finally, it is left to show that there exists K > 0 such that for every initial distribution Pq, for all n large 
and for any measurable set A C S(ao, 6 q, Co, do), 


P n (A) < KR(A) + e. 

By (25), for all n>n 2 , 

P n {A) < P [H n € A, r n - r 0 > c 0 + d 0 ] + P [r ra - r 0 < c 0 + d 0 ] 

< P [Hn € A, T n — To > Co + do] + — 


(30) 

( 31 ) 


< 


Ix’eA | m '■ 


it' 

Tj- JJ [1 — Fd+s,d,s{U, di, Sj)] > + ' 


< i^~ 1 R{A) + e. 

We have verified the conditions stated in Theorem 4 and thus the process {H n } has a unique stationary 
distribution as well implying the existence of the stationary blocking probability. □ 


Proofs of Technical Lemmas and Propositions 

Proof of Lemma 1. If r < 0, we focus on the interval (|V| — 1, [r]] and its preceding interval (|Y] —2, |"r] — 1], 
The arrival process in ([r] — 2, [r] — 1] follows a Poisson process with rate A. Each arrival has 7 probability 
of starting services immediately in ([V] — 2 , |V| — 1 ], and 1 — 7 probability of starting services in 1 unit of 
time in (|"r] — 1, [r]]. By the Poisson splitting argument, the pre-arrivals in (|Y] — 1, |"r]] follow a Poisson 
process with rate (1 — 7 )A. Using a similar argument, we conclude that the pre-arrival process in (|~r] —1, |"r]] 
induced by customers arriving to the system in ([r] — 1 , [r] ] follows a Poisson process with rate 7 A. Note that 
these two processes are independent of each other since they are generated by customers arriving in disjoint 
intervals. Now merge these two pre-arrival processes, and the resulting pre-arrival process in (|"r] — 1, |Y]] 
follows a Poisson process with rate (1 — 7 )A + 7 A = A. 

If 0 < r < 1, focus on the interval (0,1] and its preceding interval (—1,0]. By an argument similar to the 
above, there is a Poisson process of pre-arrivals with rate (1 — 7 ) A induced by customers arriving in (—1,0]. 
There is also a Poisson process with rate 7 A induced by customers arriving in (0,1], However, the latter 
process consists of post-arrivals. Thus, the resulting pre-arrivals at time 0 over (0,1] follow a Poisson process 
with rate (1 — y)A. 

Finally, since the maximum reservation time is 1, it is impossible for customers arriving prior to 0 to 
start service at any time greater than 1. Thus, the rate of pre-arrivals from 1 onwards is 0. This completes 
the proof. □ 
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Proof of Lemma 2. Suppose that a customer arrives at time 0 in steady-state and requests the service to 
commence immediately (D = 0), i.e., requesting the service interval (0,1]. Focus solely on the pre-arrivals 
as seen from 0. By Lemma 1, the pre-arrivals over the time interval (—1,0] follow a Poisson process with 
rate A, denoted by Nq. However, this implies that, over the time interval (0,1], the customers depart the 
system following a Poisson process with rate A (a shift of Nq by 1 unit of time). Let No be the mirror image 
of the departure process induced by No over (0,1]. By Lemma 1, we also know that the pre-arrivals over 
(0,1] follow a Poisson process with rate (1 — 7 )A. We denote this pre-arrival process by Ni. Figure 2 shows 
the pre-arrival and departure processes. 

Consider now the number of customers in the system at some time r. These fall exactly into one of the 
two types; customers that started service over ( 0 ,r] and customers that started service over (r — 1 , 0 ] and 
will depart over (r, 1]. It follows that the number of customers in service at time r £ (0, lj can be expressed 
as N 0 (l — r) + Ni(r). Specifically, in time r the number of departures over (r, 1] (equal to N 0 (l — r)) captures 
customers starting service before 0, and still in the system at time r. In addition, the number of pre-arrivals 
over (0,r] (equal to Aq (r)) captures customers arriving before 0, starting service over (0,r] and still being 
served in time r. The sum of the two is exactly equal to the total number of customers in the system at time 
r. Note that by the Poisson splitting argument, it follows that No and Ni are independent of each other. 
The virtual blocking probability is expressed in terms of the maximum of the sum of these two Poisson 
counting processes running towards each other (see Figure 3), i.e., 


P 0 = ¥(B | D = 0) = i 


max 

r€[0,l] 


{jVb(l-r;A)+JV 1 (r;(l- 7 )A)} >Cj 


Consider now the case that the arriving customer requests the service to commence in D = 1 unit of 
time, i.e., the service will cover the interval (1, 2]. The departure process in (1, 2] is a shift of the pre-arrival 
process Aq in (0,1] by 1 unit of time, and its mirror image is denoted by N±. Moreover, by Lemma 1, the 
pre-arrival process A7 2 in ( 1 , 2 ] has rate 0. Thus, we have 


P 1 = 


F(B | D = 1) = P ^max {fVi(l -r;(l - 7 )A) + A^ 2 (r;0)} > cj = P (jV"i(l; (1 - 7 )A) > c) . 


This completes the proof. 


□ 


Proof of Lemma 3. Note again that for each r £ [0,1], A7 0 (l — r; $iA) + 7Vi(r; A) is equal to the sum of the 
number of occurrences of No over (1 — r, 1] and the number of occurrences of Ni over [0,r). Also observe 
that the value of X is obtained either at time 0 or upon on occurrence of TVi. Now condition on lZ n = u> n (a 
specific realization of the random walk 7 Z n ), and consider the I th occurrence of N\ (l £ {0,..., n}), at time, 
say r. Then we have (see Figure 3), 

iVo(l — r; A) + Ni(r; 6±A) = (# up-steps before and including l + # down-steps after l) 

= (# up-steps before and including l — ff down-steps before and including l) 

+(# down-steps before and including l + ff down-steps after l). 

The first term is exactly the location of the random walk after l steps and the second expression is exactly 
G n . Since X is the maximum of the above sum over all arrivals l = 0,1,..., n, it follows that indeed 
X n | (TZ n = (jJ n ) = ( G n + M n ) | (7 Zn = w n ), from which the result follows. □ 


Proof of Lemma 4-. Define the stopping time r as follows, r = inf {t > 1 : St < —a or St > b} . It is straight¬ 
forward to check the following two conditions, 


E(r) < 00 , E(|Jf t+ i — E t \ | Tt) < 2, Vt £ r. 
The Wald’s identity (see Gallager (1996)) 


G n {d) 4 


a es n 


mv 


(32) 


(33) 
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is a martingale where the moment generating function <f>{6) = E(e ey ) > 1. First we compute 9 that solves 
the equation E(e eY ) = 1, i.e., 


E(e §Y ) = pe § + qe § = 1 => e § = -. 

P 

By Optional Sampling Theorem (see Gallager (1996)), 


r js T 






= E 

e ss - 

= E 

e 0 So 

[m\ T \ 




L J 


This leads to 

F(S r > b) R(e i3r I S T > b) +(1 - P(5 T > 6 )) E(e e " s - | S T < - a ) = 1 . 


Thus, we have 


(34) 


(35) 


(36) 


F(S r > b) 


1 -E 


a 


Eb — E a 


1 - e~ Sa 

gQb _ e,—® a 



(37) 


Let Sf = S T be the stopping time location of the process. Let B a be the event that the random walk hits 
b before —a. Observe that P (B a ) = P(5“ > b) and also note that Bi C B i+ 1 for all i. Define B = (Ji^i -Bj, 
i.e., there exists an i that the random walk hits b before —i. Therefore P(M 00 > b) = P(P). By properties 
of probability measures, we have 


P(M^ > b) 


P(M B i) = lim P ( S a) 

a—too 

i=1 




(38) 


This completes the proof. 


□ 


Proof of Lemma 5. Lemma 5 is a generalized version of Lemma 1. For r < 0, consider the time interval 
([~r] —1, |Y]]. By arguments similar to those used in Lemma 1, for each l £ [0, it], the interval (|"r] — 1—1, |r] — 1] 
generates a stream of pre-arrivals over (|Y] — 1, |~r] ] that follow a Poisson process of rate 7 ; A. These processes 
are independent of each other and the overall merged process has rate A = 70 A + 71 A + .. .+ 7 „A. For [r] = d 
for d £ [l,u], then the pre-arrivals prior to t over (|~r] — 1 , |"r]] are induced by arriving customers over the 
intervals ([r] — l — 1, |Y| — Z], for l £ [d, it], and the total rate is 7 ^A + 7 d+iA + ... + 7 M A. Note again that 
the rate 7 jA is induced from the Poisson arrival stream of customers over ([r] — l — 1, |"r] — l] who wish to 
start in l units of time. Since we only consider pre-arrivals prior to t, the terms 7^-1 A, 7 d_ 2 A,... , 7 oA are 
missing. □ 

Proof of Lemma 6. By Lemma 5, for each d G [0, it], the pre-arrival process N ( i over the interval (d — l,d] 
follows a Poisson process with rate Ad = A ^1 — J2i=o • This implies that over the interval (d, d + 1], the 
customers depart the system following a Poisson process with rate A d (a shift of Nd by 1 unit of time). Let 
Nd be the mirror image of the departure process induced by Nd over (d, d + 1 ], and therefore Nd has the 
same rate A d- The rest of arguments is identical to that of Lemma 2. □ 

Proof of Proposition 2. First we assume that 70 > 0. By Lemma 6 , we have that Ao > Ai and A d > Ad+i for 
each d £ [l,it]. By Proposition 1, it follows that, 

lim P 0 = i; lim Pd = 0, for d € [l,u]. 

A—>-00 2 A—>00 
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Therefore Pi < A holds given that 70 > 0. In fact, we can relax the assumption of 70 > 0. If 70 = 0, it 
implies that over the interval (0,1] (recall that the customer arrives at time 0 in steady-state), the departure 
rate is equal to the pre-arrival rate, i.e., Ao = Ai = A. Proposition 1 cannot be applied under this case. 
However, the fact that 70 = 0 implies that no arriving customers will start the service right away. Therefore, 
we do not have to consider the probability Pq in the expression of P. Let the index i = min{d : 7^ > 0}. 
Then we have 7^ = 0 for d £ [0, * — 1], by the same argument, we can ignore the probabilities Pq, • • •, Pi- 1- 
Instead, again by Proposition 1, we have 

lim Pi = —; lim Pd — 0, d £ [i + l,u]. 

A—»oo 2 A—>-oo 

This completes the proof. □ 


Proof of Lemma 7. For each set s £ [1, t/], and d £ [0, it], the pre-arrivals prior to t (i.e., iVJ) over (d — s,d — 
s + 1] are induced by arriving customers over the intervals ( d—s — i , d—s—i + 1] for i = max(0, d—s+1 ),..., it, 
and the total rate X s d is therefore 


7max(0 ,d- 


\ s 

s+l) A 0 


+ • ■ ■ + 7«^o — Aj 




(39) 


Note again that the rate 7? is induced from the Poisson arrival stream of customers over [d— s — i,d— s — i + 1] 
who wish to start in i units of time. It follows from the Poisson splitting argument that 7VJ and TVj, are 
independent if (d,s) ^ ( d',s '). This completes the proof. □ 


Proof of Lemma 8. The assumption 7 q > 0 for some s £ [l,u] implies that in the interval (0,1], the total 
departure rate is strictly greater than the total pre-arrival rate, i.e., X^s=i A0 > Es=i A*. For subsequent 
intervals (d, d + 1] for d > 1, we have X^s=i A d — e: = 1 a^ + s . Therefore the conditions of Proposition 1 are 
satisfied. Proposition 1 implies that 


( / V s —1 V \ \ 

EEW;»:)+E»i(W!)p c 

\s=2 i= 1 s=l / / 

/ /vs-1 V \ \ / / « \ A 

lim P I Poisson ££a*+£ Aq I > C I = lim P I Poisson | sAq ) > C 


(40) 


^s=l 


= lim P ( Poisson f sk s X ] > C | = lim P(Poisson(p) > C) = 
X—iOO \ \ ^ J J X—>00 2 


The third equality of (40) follows from (3) in Lemma 7. Similarly, we can show that limA-j-oo P(Ai > C) = 0 
for d £ [l,it]. This completes the proof. □ 


Proof of Proposition 3. First we assume that 79 > 0 for some s £ [1, u]. For each s £ [l,i>], by applying 
union bound and Lemma 8, we have 


lim Pq = lim P(max(Ho,... ,Ad- 1) > C) < lim P ( II Ai > C | 

A—>-oo A— ^00 X—^oo \ / 

\i =0 / 


( 41 ) 


d -1 


< lim VP (At >C)= lim F(A 0 > C) = 

\—>oo ' ^ 9 


2=0 


A —>00 


On the other hand, it is obvious that, for each s £ [l,u], 


lim Pq = lim P(max(^4o, • • • , ^4 s -i) > C) > lim P(^4 q > C) = 


A—F 


A^ 


A—>-oo 
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Similarly, limA->oo PJ = 0 for each d £ [l,u] and s £ [l,u]. 

We then drop the assumption that 7 q > 0 for some s £ [1, u]. Suppose now 7 q = 0 for all s € [1, u]. This 
implies that no arriving customers at time 0 will start the service over ( 0 , 1 ], and hence we can ignore the 
blocking probability over this interval. Let the index 

i = min {d : 7 J > 0 for some s £ [ 1 , i>]} . 

Observe that no arriving customers at time 0 will start the service over (0, *]. For the subsequent interval 
(i. i + 1], the total departure rate is strictly greater than the pre-arrival rate, i.e., ]W =1 Af > X^'=i ^i+ s - 
Thus, it suffices to show that for each s £ [1, u], limA^-oo Pf = limA-^oo IP(max(Alj,..., A i+S _ 1 ) > C) = 1/2, 
and limA^-oo PJ = 0 for each d £ [i + 1, u] and s £ [1, u]. The same arguments follow through. □ 

Proof of Lemma 9. Consider the following LP 

M M 

max EE r k&dsk^dsk s i S.t. EE oP dsk \ dsk s < C, 0 < a dsk < 1 , Vd, s, k. (42) 

dsk k= 1 d,s k= 1 d,s 

Note the LP defined in (7) differs from the LP defined in (42) by changing the right hand side of the capacity 
constraint to (1 — e)C. Suppose the optimal solution of the LP defined in (42) is {adsk}- Now consider 
{&dsk} = {(1 - e)a dsk }. Since 

M M 

EE &dsk^dskS — (1 EE ^dsk^dskS E (1 1 (43) 

k— 1 d,s k— 1 d,s 

{&dsk} is a feasible solution to (7). Then we have 

MM M 

EE r k a.d sk ^ds k S > EE T'k&dsk^dskS (1 EE a d sk\dskS > (1 - c)TZ(OPT). (44) 

k —1 d,s k—1 d,s k— 1 d,s 

The last inequality holds since the optimal objective value in (42) provides an upper bound on the optimal 
expected revenue rate, since the capacity constraint is enforced on expectation whereas in the original problem 
this capacity constraint has to hold, for each sample path. This completes the proof. □ 
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